Cognitive determination of message suitability

ABSTRACT

Cognitive determination of whether a message is suitable for sending over a data communications network can include extracting tokens from the message prior to transmitting the message. One or more intended recipients of the message can be determined from the tokens. A machine learning classification model corresponding to the one or more recipients of the message can be selected. The machine learning classification model can be constructed based on tokens extracted from prior messages, which are combined to create a plurality of documents for training the machine learning classification model. The one or more tokens extracted from the message can be classified using the machine learning classification model. An alert message can be generated in response to determining based on the classifying that the message is unsuited for sending.

BACKGROUND

This disclosure relates to data communications networks, and moreparticularly, to multi-party messaging over a data communicationsnetwork.

Instant chat messaging and similar technologies allow users tocommunicate in real time over a data communications network, such as alocal area network and the Internet. Using such technologies, users alsocan communicate using Voice over IP, share images, engage in videochats, access data using hyperlinks, and transfer files. Multiple userscan establish chatrooms and engage in online chats with one anotherusing such technologies. Similarly, cloud-based instant messagingplatforms can provide an online workspace for users to workcollaboratively on team projects.

SUMMARY

In one or more embodiments, a method includes extracting, with computerhardware, tokens from a message prior to transmitting the message over acommunications network. The method also includes determining from thetokens one or more intended recipients of the message. Additionally, themethod includes selecting a machine learning classification modelcorresponding to the one or more recipients of the message. The machinelearning classification model can be constructed based on tokensextracted from prior messages, which are combined to create a pluralityof documents for training the machine learning classification model. Themethod also includes classifying one or more tokens extracted from themessage using the machine learning classification model. The methodfurther includes generating an alert message in response to determiningbased on the classifying that the message is unsuited for sending.

In one or more embodiments, a system includes a processor configured toinitiate operations. The operations include extracting tokens from amessage prior to transmitting the message over a communications network.The operations also include determining from the tokens one or moreintended recipients of the message. Additionally, the operations includeselecting a machine learning classification model corresponding to theone or more recipients of the message. The machine learningclassification model can be constructed based on tokens extracted fromprior messages, which are combined to create a plurality of documentsfor training the machine learning classification model. The operationsalso include classifying one or more tokens extracted from the messageusing the machine learning classification model. The operations furtherinclude generating an alert message in response to determining based onthe classifying that the message is unsuited for sending.

In one or more embodiments, a computer program product includes acomputer readable storage medium having instructions stored thereon. Theinstructions are executable by a processor to initiate operations. Theoperations include extracting tokens from a message prior totransmitting the message over a communications network. The operationsalso include determining from the tokens one or more intended recipientsof the message. Additionally, the operations include selecting a machinelearning classification model corresponding to the one or morerecipients of the message. The machine learning classification model canbe constructed based on tokens extracted from prior messages, which arecombined to create a plurality of documents for training the machinelearning classification model. The operations also include classifyingone or more tokens extracted from the message using the machine learningclassification model. The operations further include generating an alertmessage in response to determining based on the classifying that themessage is unsuited for sending.

This Summary section is provided merely to introduce certain conceptsand not to identify any key or essential features of the claimed subjectmatter. Other features of the inventive arrangements will be apparentfrom the accompanying drawings and from the following detaileddescription.

BRIEF DESCRIPTION OF THE DRAWINGS

The inventive arrangements are illustrated by way of example in theaccompanying drawings. The drawings, however, should not be construed tobe limiting of the inventive arrangements to only the particularimplementations shown. Various aspects and advantages will becomeapparent upon review of the following detailed description and uponreference to the drawings.

FIG. 1 depicts an example communications environment in which a systemfor determining message suitability operates according to an embodiment.

FIG. 2 depicts an example system for determining message suitabilityaccording to an embodiment.

FIGS. 3A and 3B schematically illustrate certain operative features ofan enhanced neural net image caption generator according to anembodiment.

FIG. 4 schematically illustrates certain operative features of a systemfor determining message suitability according to an embodiment.

FIG. 5 is a flowchart of a method of determining message suitabilitybased on images according to an embodiment.

FIG. 6 is a flowchart of a method of creating a group topic model andindividual topic model according to an embodiment.

FIG. 7 is a flowchart of a method of training an enhanced neural netimage caption generator with machine learning according to anembodiment.

FIG. 8 depicts a cloud computing environment according to an embodiment.

FIG. 9 depicts abstraction model layers according to an embodiment.

FIG. 10 depicts a cloud computing node according to an embodiment.

DETAILED DESCRIPTION

While the disclosure concludes with claims defining novel features, itis believed that the various features described within this disclosurewill be better understood from a consideration of the description inconjunction with the drawings. The process(es), machine(s),manufacture(s) and any variations thereof described herein are providedfor purposes of illustration. Specific structural and functional detailsdescribed within this disclosure are not to be interpreted as limiting,but merely as a basis for the claims and as a representative basis forteaching one skilled in the art to variously employ the featuresdescribed in virtually any appropriately detailed structure. Further,the terms and phrases used within this disclosure are not intended to belimiting, but rather to provide an understandable description of thefeatures described.

This disclosure relates to data communications networks, and moreparticularly, to multi-party messaging over a data communicationsnetwork. Notwithstanding the benefits brought by instant chat messagingand similar technologies, there can be times in which a message can leadto undesirable results. The message may use terms or reference one ormore topics that offend certain sensitivities of certain individuals.The message may include an incautious comment that has previously provenproblematic when conveyed to one or more members of specific group(e.g., a chat group). The message may inadvertently discloseconfidential information to one or more individuals who are not part ofa limited group (e.g., collaborative work group) that is authorized toreceive the information.

In accordance with the inventive arrangements disclosed herein, messagesunsuited for sending are automatically identified before being sent overa communications network. Among various aspects of the methods, systems,and computer program products disclosed herein are certain machinelearning models that automatically learn to identify and classifymessages.

In certain embodiments described herein, a machine learning model fordetermining message unsuitability is trained using example documentscreated by combining prior messages. The prior messages comprise textstrings, which can be collected from text-based messages as well as fromspeech converted to text by a speech-to-text processor. The text stringsalso can be collected using the enhanced convolutional neural net imagecaption generator disclosed herein. The enhanced convolutional neuralnet image caption generator combines image recognition and machinelearned topic identification capabilities. Image-related text generatedby the enhanced convolutional neural net image caption generatorprovides an additional source of examples for training a machinelearning model to determine message suitability/unsuitability,specifically with regard to messages that contain one or more images.

A system, in accordance with some embodiments, can extract one or moretokens from a message prior to transmitting the message over acommunications network. The system can determine from the tokens one ormore intended recipients of the message. At least one machine learningmodel corresponding to the one or more recipients of the message can beselected by the system, the machine learning model(s) trained withtokens extracted from prior messages that were combined to create aplurality training documents. The system can classify the one or moretokens extracted from the message using the machine learning model(s).The system can generate an alert message in response to determiningbased on the classifying that the chat message is unsuited for sending.To maintain the accuracy and relevancy of the machine learning model(s)for determining message suitability, new documents for training themachine learning model(s) can be created at periodic intervals over apredetermined time period based on recent messaging.

In certain embodiments, the machine learning model is a probabilistictopic model that statistically determines at least one topic thatcharacterizes the language content of a plurality of documents. Anexample of a probabilistic topic model disclosed herein is an augmentedlatent Dirichlet allocation model. The augmented latent Dirichletallocation model can be augmented based on a group relationship graph,as also disclosed herein.

The arrangements described herein are directed to computer technologyand provide an improvement to computer technology. Specifically, thepresent arrangements improve messaging systems by providing forautomatic recognition of messages that are not suited for sending over adata communications network. Without human intervention, such a messagecan be identified before the message is sent. The sending of the messagecan be automatically blocked before the message is sent once the messageis determined to be unsuitable for sending. Overall efficiency of amessaging system is enhanced by determining messagesuitability/unsuitability without the need for a manual compilation ofcharacteristics that would otherwise be necessary for making thedetermination. Rather, the determination can be based on the machinelearning models disclosed herein, which can be trained to recognizemessage unsuitability without human instruction or intervention.

Further aspects of the arrangements described within this disclosure aredescribed in greater detail with reference to the figures below. Forpurposes of simplicity and clarity of illustration, elements shown inthe figures have not necessarily been drawn to scale. For example, thedimensions of some of the elements may be exaggerated relative to otherelements for clarity. Further, where considered appropriate, referencenumbers are repeated among the figures to indicate corresponding,analogous, or like features.

FIG. 1 depicts communications environment 100, which is an exampleenvironment in which a system for determining message suitabilityoperates in accordance with one embodiment. Communications environment100 illustratively includes multiple users 102 a, 102 b, and 102 n whocommunicate with one another using communication devices 104 a, 104 b,and 104 n, respectively. Although only three such users and user devicesare shown, it will be readily recognized that communications environment100 can include any number of users and user devices.

Communication devices 104 a-104 n can comprise various types ofelectronic devices, including, for example, a smartphone or other mobiledevice, a computer (e.g., desktop, laptop, tablet computer), virtualassistant, smart TV, or other communication/computing device. It will beappreciated that in various embodiments one or more of communicationdevices 104 a-104 n can be deployed as a standalone device or deployedas multiple devices in a distributed client-server networked system. Forexample, in certain embodiments, a smartwatch can operatively couple toa mobile device (e.g., phone).

Communication devices 104 a-104 n communicatively couple with oneanother via communications network 106. Communications network 106provides communication links between various devices and data processingsystems. Communications network 106 can link users 102 a-102 n usingcommunication devices 104 a-104 n, for example, to an instant messagingservice, a team collaboration service, a social networking service, orsimilar service or messaging platform. The communication links caninclude connections, such as wired communication links, wirelesscommunication links, or fiber optic cables, and can be implemented as,or include, one or more (or any combination of) different communicationtechnologies such as a wide area network (WAN), a local area network(LAN), a wireless network (e.g., a wireless WAN and/or a wireless LAN),a mobile or cellular network, a virtual private network (VPN), theInternet, a public switched telephone network (PSTN), and so forth.

As defined herein, “communication link” means a mode of communicationusing one or more electronic devices. A communication link is associatedwith a specific format and/or communication protocol for sendingmessages. For example, using a specific format and/or communicationprotocol, an electronic device can send a message to another electronicdevice as a text message, an email, a video call, a voice call, and/or apost to a social networking system. A communication link for exchangingtext messages is considered a distinct communication link. Likewise, acommunication link for exchanging emails is a distinct communicationlink, as is a communication link for video calls, as is a communicationlink for voice calls. So, too, a communication link used for posting toa social networking system is considered a distinct communication link.That is, each type of communication link corresponding to a differenttype or mode of communication is considered a distinct communicationlink.

Illustratively, each of communication devices 104 a-104 n is endowedwith processing capabilities and/or hardwired circuitry 108 a, 108 b,and 108 n that connects to system 110 for determining the suitability ofa message before a user sends the message via communications network 106to one or more other users, such as members of a chat group, members ofa collaborative work group, or individuals interacting over an on-linesocial network. System 110, for example, can be operatively coupled toor integrated in an instant messaging service, a team collaborationservice, a social networking service, or similar service or messagingplatform which communication devices 104 a-104 n are communicativelylinked via communications network 106.

System 110, in certain embodiments, is implemented as a set of computersystem-executable instructions illustratively executing on server 112,which communicatively couples to communication devices 104 a-104 n viacommunications network 106. Accordingly, system 110 can be implementedin various types of computer systems (e.g., cloud-based server) such ascomputer system 1012 described with reference to FIG. 10 . In otherembodiments, system 110 can be implemented in hardwired circuitry or acombination of circuitry and computer system-executable instructions.Illustratively, user 102 a communicates text message 114, user 102 bcommunicates spoken message 116, which is converted to text by aspeech-to-text processor (not shown), and user 102 n communicates amessage containing image 118, each of which is conveyed overcommunications network 106 during a conversation involving an exchangeof multiple messages between the specific users over a specific span oftime.

FIG. 2 depicts example system 200 for determining suitability of amessage prior to sending the message, according to an embodiment. System200 illustratively includes token processor 202, classifier modeler 204,token classifier 206, and alarm processor 208, each of which can beimplemented as a set of computer system-executable instructions,dedicated circuitry, or a combination of dedicated circuitry andexecutable instructions.

System 200 determines the suitability of a message based on a machinelearning classification model generated by classifier modeler 204 andimplemented by token classifier 206. Token classifier 206 classifies oneor more words contained in the message, the words represented by tokensextracted by token processor 202 from one or more text stringscomprising the message. The message can be a text-based message, inwhich case the text string is the message text itself. The message canbe a voice-based message, in which case the text string is generated byconverting the corresponding speech to text with a speech-to-textprocessor (not shown). The message can comprise an image, in which caseone or more text strings corresponding to the image can be generatedusing an embodiment of the enhanced neural net image caption generatordescribed below.

As defined herein, “text string” is a sequence of alphabeticalcharacters, numeric characters, symbols (e.g., emoji) and/or punctuationmarks. Token processor 202 segments the text string into tokens. Asdefined herein, a “token” is a word, number, or punctuation mark derivedfrom the specific sequence of characters contained in a text string.Token processor 202 can identify sentence boundaries (e.g., based onpunctuation and/or whitespace in the message) and identify wordscorresponding to tokens within the boundaries.

Token processor 202 is automatically invoked by system 200 in responseto a user creating a message using a device (e.g., smartphone, computersystem) that can communicatively couple to a communications network.Prior to delivery of the message to one or more recipients over thecommunications network, token processor 202 extracts one or more tokens(words) from the message and, based on the extracted token(s),determines one or more intended recipients of the message. System 200invokes token classifier 206. If token classifier 206, based on theclassification model generated by classifier modeler 204, determinesfrom the tokens extracted from the message that the message isunsuitable for sending, then alarm processor 208 is invoked. Alarmprocessor 208 generates a message warning the user (message sender) thatthe message is unsuited for sending. As defined herein, “unsuited forsending” refers to a message that is determined based on the machinelearning classifier model to include language (identified by tokensrepresenting words) that is likely (statistically) to offend a recipientof the message, create misunderstanding, and/or disclose privileged orconfidential information to unauthorized persons. Optionally, alarmprocessor 208 can automatically block the sending of a messagedetermined to be unsuited for sending.

In certain embodiments, token classifier 206 makes asuitability-versus-unsuitability determination with respect to a messagebased on an association between tokens (words) extracted from themessage and topics identified by a topic model generated by classifiermodeler 204. The appearance within a message of words associated withtopics deemed objectionable can render the message unsuitable forsending.

A message can be unsuitable for sending owing to any number of reasonshaving to do with a specific topic. A message may be unsuitable becausethe message covers a topic that offends the sensibilities of anindividual or group of individuals. For example, a message concerningthe topic of meat consumption shared with members of a chat group canoffend chat group members who may be strict vegetarians. A message maybe unsuitable because the message covers a confidential topic. Forexample, a message concerning a topic relating to a research anddevelopment project may be unsuitable for sending to individuals outsideof a limited-member collaboration group. Express user input can mark atopic as objectionable. Alternatively, a machine learning classificationmodel can be trained to recognize objectionable topics based on a priorexchange of messages, as described below.

The topic model generated by classifier modeler 204, in someembodiments, is a probabilistic topic model generated using machinelearning. The probabilistic topic model can discover or identify topicsor themes appearing in a plurality of textual documents based on thewords in the documents. Connections between topics and how the topicschange over time can also be determined by the probabilistic topicmodel.

The probabilistic topic model is generative in the sense that the modeltreats data as arising from a generative process that includes so-calledhidden random variables. The generative process defines a jointprobability distribution over both observed and hidden random variables.The joint distribution is used to compute a conditional distribution(posterior distribution) of the hidden random variables given theobserved random variables. An aspect of topic modeling, therefore, isapproximating the conditional distribution. The approximation can bedetermined using sampling-based methods (e.g., Gibbs sampling) orvariational methods. In various embodiments, different probabilistictopic models can be created by classifier modeler 204. One probabilistictopic model disclosed herein is an augmented latent Dirichlet allocationmodel, which is described in detail below.

Classifier modeler 204 constructs a probabilistic topic model usingmachine learning and based on tokens extracted from prior messages. Thetokens can be stored in processed tokens database 210 and annotated withone or more indicators. The indicators can indicate, for example, thetime the tokens representing the message were saved (“message time”); anassigned message identifier (“message ID”) used to correlate the tokento the particular message from which the token was extracted; amessage's author (“sender ID”); a message recipient (“recipient ID”);and/or a messaging group identifier (“group ID”), which as definedherein is an alpha-numeric sequence and/or other symbolic representationcorresponding to the message sender and each message recipient. Thetokenized representations of prior messages are combined to create aplurality documents corresponding to message text strings, which can bestored in documents database 212 and used for training one or moreprobabilistic topic models using machine learning.

Following is an example document, termed an “aggregated messagesdocument” (AMD), created by combining or aggregating multiple priormessages exchanged over a specific time period between an identifiablegroup of users (e.g., chat group, collaborative work group):

User ID Message Time User A Let's go out for lunch, anyone have anysuggestions? 11:00 AM User B How about barbeque at the Bar B Qrestaurant around the corner? 11:01 AM User B [image of barbeque meatplatter] 11:02 AM User B I propose we order the pork platter special forthe whole team. 11:02 AM User C That looks delicious. 11:02 AM User DOh, pork is indeed delicious, but two of our team members are 11:03 AMstrict vegetarians, so please do not post a message like this again.User B Sorry about that, how about pizza instead? 11:04 AM User D Goodidea, let's all go to Joe's Pizza Place for pizza at noon. 11:05 AM

Although the messages occur over a relatively short time span andinvolve an innocuous discussion regarding where the group should meetfor lunch, the document highlights the fact that, as demonstrated below,an AMD can cover multiple topics for training a probabilistic topicmodel using machine learning.

An example probabilistic topic model generated by classifier modeler204, in accordance with one or more embodiments, is the augmentedlateral Dirichlet allocation (aLDA) model. Through unsupervised machinelearning based on input comprising a set of AMDs created by combiningmultiple messages, the aLDA model learns to identify topics. Each AMDcomprises a specific group of individuals' messages exchanged over aspecific time span, as in the example above. The individuals exchangingmessages define a group (e.g., chat group, collaborative work group) andthe specific messages comprise messages exchanged during a specifiedtime period.

Operatively, classifier modeler 204 generates the aLDA model byinitially assigning to each token (word) a corresponding ID, such as aninteger number from 1 to n where n is the size of a vocabulary.Initially, classifier modeler 204 randomly assigns a topic to each tokenin each document used to train the model, each topic identified by aninteger from 1 to k where k is the number of topics (which can bepredetermined) identified within the documents.

Classifier modeler 204 generates a topic count matrix that indicates thenumber of times that a particular token (word) is associated with eachof k topics. The task of the aLDA is to determine based on the tokensextracted from the documents, the likely topics embodied in the messageswithin the documents. Classifier modeler 204 generates a document-topiccount matrix, each element of which indicates the number of tokensassigned to each topic in each document. Although initially topics areassigned to each token randomly, through successive iterations anoptimal allocation of tokens to topics is determined. The optimalallocation is determined by representing each document as a mixture oftopics that generate words with certain probabilities and assuming thateach document was generated by (1) deciding on the number of words toinclude in the document (e.g., based on a Poisson distribution); (2)choosing a mixture of topics for the document (e.g., based on aDirichlet distribution over a fixed set of k topics); and (3) generatingeach work in the document by picking a topic and generating the wordbased on the topic (e.g., according to a multinomial distribution).

In one embodiment, the optimal allocation is determined by classifiermodeler 204 using collapsed Gibbs sampling. Collapsed Gibbs sampling isbased on the product of the probability that a word is associated with agiven topic times the probability that the topic appears in a document.After several iterations, the probabilities that a token is associatedwith each topic converge to stable values, and each token is assigned toa topic (1 through k) having the highest probability.

The aLDA is augmented by assigning weights to extracted tokens, theweights influencing the respective probabilities and thus making topicsassociated with more heavily weighted tokens more likely to be“discovered.” A topic is more likely discovered or identified thegreater the number of tokens (words) corresponding to the topic drawnfrom the documents. A token (word) that appears more frequently and/orthat is more heavily weighted than other tokens thus has a greaterlikelihood that a topic corresponding to that token will be identified.

The weights can be based on a group relationship graph. One or moregroup relationship graphs are stored in graph relationship graphdatabase 214. A group relationship graph can be based on relationshipsbetween different individuals that belong to a specific group ofindividuals who exchange messages with one another over a specified timeperiod. Different weights can be assigned to members of the group basedon specific relationships. For example, a group can comprise acollaborative work group, and tokens (words) extracted from messagesthat originate from the leader of the group can be weighted more heavilythan other tokens. If in the earlier example of a group making plans forlunch, user D were the team's leader, tokens (words) extracted from userD's 11:03 message can be weighted more highly so that a group topicmodel will more likely identify the topics (e.g., meat and its avoidancewith respect to vegetarians) of importance to user D. User D'srelationship to the other members of the group makes topics ofimportance to user D important to other members as well. If differentmembers of the group have different levels of responsibility, weightsreflecting the different levels of responsibility can be assigned tomessages from each member.

In other embodiments, weights for augmenting the aLDA model can reflectthe relative contributions of each member of a messaging group byweighting tokens extracted from messages of a user according to thenumber of messages a user contributes. Accordingly, in one embodiment,initial weights for all tokens can be set to one and the weights updatedaccording to the formula (1+n)/N, where n corresponds to the number ofmessages attributed to a user and N is equal to the total number ofmessages in document.

Using a time-based job scheduler utility (e.g., Unix-based cronoperating system utility), token processor 202 can periodically, atscheduled time intervals, extract tokens from recent messages accessibleby system 200. Classifier modeler 204 can query the processed tokensdatabase 210 periodically to determine whether and, if so, how manynewly processed tokens (from recent messages) have been stored in thedatabase. Accordingly, classifier modeler 204 optionally updates the setof documents and topic models based on documents newly created atperiodic intervals based on new messages.

System 200 illustratively comprises two types of topic models generatedby classifier modeler 204. One type, group topic model 216, pertains toa group, such as a chat group, collaborative work group, or other groupof users that exchange messages over time. Different group topic modelscorresponding to specific time spans can be generated for differentgroups of users. The other type, individual topic model 218, pertains toindividual members of a group.

Group topic model 216 is constructed based on documents (AMDs) createdby querying processed tokens database 210 and collecting messages whoseIDs correspond to specific members of a group (e.g., chat group,collaborative work group) and which are identified has having beenexchanged within a specified time period. Based on the documents, grouptopic model 216 is constructed using machine learning, as describedabove. Individual topic model 218 is constructed based on anindividual-specific document created from messages identified with aspecific individual member. The individual-specific document is combinedwith group topic model 216 for constructing individual topic model 218.Individual topic models reflect topics relevant to specific individuals,whereas the group topic model relates to topics relevant in the specificcontext of an identifiable group. Each such model indicates groups ofwords (tokenized) that correspond to topics. Because the topics aregenerated from documents that aggregate messages of a specific group ofindividuals during a specific timeframe, the topics reflect particularaspects of the individuals (e.g., views, opinions, objectives). Bothtypes of models thus can be used to identify topics, and moreparticularly, words associated with topics that determine whether amessage intended for the group or for one or more individuals in thegroup is unsuitable for sending.

Group topic model 216 and individual topic model 218, based on themachine learning described, associate tokens (words) with topics. When anew message is created, token processor 202 extracts tokens from themessage prior to the message being conveyed over communications network106. Token classifier 206 determines whether any of the words correspondto topics that make the message unsuitable for sending. A topic can bedesignated as one whose associated words make the message unsuitable forsending based on user input to token classifier 206 and/or based ongeneral information collected in general knowledge database 220, asdescribed in greater detail below. The leader of a collaborative workgroup, for example, may indicate that topics (and hence the associatedwords) pertaining to a research and development project are restrictedin so far as any message relating to the topics should not be sent toanyone other than a team member. A member of a chat group that includesa strict vegetarian, for example, may designate topics pertaining tomeat consumption as topic whose associated words render a messageunsuitable for sending. Alternatively, the knowledge that vegetariansare offended by meat consumption may be obtained from general knowledgedatabase 220.

In some embodiments, a system for determining message suitabilityincludes an enhanced neural net image caption generator that, asdisclosed herein, combines the capabilities of image recognition andtopic modeling. The enhanced neural net image caption generator, inaccordance with some embodiments, performs image recognition using aconvolutional neural network to identify and caption objects in animage. The corresponding caption is input into a probabilistic topicmodel for training the model using machine learning. The probabilisticmodel, once trained, can associate a topic corresponding to an imageappearing in a newly presented message. The enhanced neural net imagecaption generator, as with other elements of a system for determiningmessage suitability, can be implemented in various embodiments in a setof computer system-executable instructions, in dedicated circuitry, or acombination of dedicated circuitry and computer system-executableinstructions.

FIGS. 3A and 3B illustrate certain features 300 of an enhanced neuralnet image caption generator according to one embodiment. FIG. 3A depictscertain training aspects of the enhanced neural net image captiongenerator, the training based on machine learning using a set oftraining examples. A machine learning training example illustrativelycomprises image 302 and corresponding message 304. Image 302 is inputinto convolutional neural network (CNN) caption generator 306, whichgenerates an image caption corresponding to image 302. The image captionand message 304 corresponding to image 302 are input into classifiermodeler 308 (e.g., the aLDA described above). CNN caption generator 306can generate a caption using a fixed vocabulary, the caption describingobjects or content within image 302. CNN caption generator 306 can beimplemented, for example, using an encoder model (e.g., a deep learningconvolutional neural network) and decoder (e.g., a long short-termmemory (LSTM) neural network) model that is trained conditionally on theencoding by the encoder model to output text (e.g., word, phrase, orsentence) that describes or otherwise identifies the objects or contentwithin image 302.

Operatively, CNN caption generator 306 efficiently predicts an objectwithin an image, in part, by distinguishing close-together pixels thatcorrespond to the same object from the close-together pixels thatcorrespond to edges of different objects—that is, parts of an imagewhere two different objects touch one another. Each pixel of image 302is a feature (e.g., a 100-by-100 pixels image can be represented by10,000 features of a feature vector). At block 310, CNN captiongenerator 306 can split image 302 into square patches 312 using a movingwindow, and multiple regression models (e.g., single-layer perceptron)can each receive an image patch for machine learning to detect aspecific pattern (e.g., one small regression model can learn to detectsky, another to detect grass, and a third to detect a building). Throughmachine learning, each small regression model learns the parameters of afilter using gradient descent with backpropagation. Through successiveiterations, each filter slides—or convolves—over the patches of animage. At each iteration, a convolution is computed (e.g., theconvolution value is greater the more a patch “looks like” a filtercorresponding to a specific object) and a nonlinear activation function(e.g., rectified linear unit (ReLU) function) is applied to the sum ofthe convolutions. Once trained, the CNN can predict, based onmodel-generated values, objects within an image. Using such techniques,CNN caption generator 306 can be trained to identify objects within animage such as image 302 and apply a caption describing the object.Classifier modeler 308 extracts tokens (words) from correspondingmessage 304 at block 314 for identifying topics and maps the tokens tothe image at block 316 to generate newly labeled image 318. The labelcan identify a topic associated with the objects in image 302. At block320, the newly labeled image (now associated with a corresponding topic)is used to train CNN caption generator 306.

FIG. 3B depicts certain operations performed by the enhanced neural netimage caption generator once trained using machine learning. An image322 and corresponding message 324 are input into enhanced neural netimage caption generator. Image 322 is processed by the CNN captiongenerator 306, the output of which is conveyed to classifier modeler 308along with corresponding message 324. Classifier modeler 308 at block326 determines a topic associated with image 322 and classifies theimage accordingly. If image 322 is classified as unsuitable for sendingas part of a message, alarm processing is invoked at block 328 forgenerating a warning that the message is unsuitable for sending.

Certain operative features of the enhanced neural net image captiongenerator can be demonstrated in the context of the above-describedgroup chat example in which colleagues exchange messages regardingmeeting for lunch. As described above, one user (User B) sends to thegroup a message accompanied by a picture that includes a meat platter,which evokes a follow-up response warning that some members of the groupare strict vegetarians and object to eating meat. The message exchange,including the image, can provide a training example for training theenhanced neural net image caption generator to recognize certain objects(meat) and a topic model can learn to associate the objects with a topicdetermined to be objectionable for certain members of a particular groupof individuals. Accordingly, if during a subsequent exchange of messagesinvolving members of the group, one member prepares a message thatincludes an image showing prepared meats, a warning is sent to themember prior to the message being sent. The warning indicates that themessage is unsuitable for sending given that the message refers to atopic (eating meat) that at least some members find objectionable. In anexample implementation, the system may query the user whether to proceedwith sending the message or discard the message so that the message isnot delivered to the originally intended recipients.

FIG. 4 schematically depicts certain operative features 400 of a systemfor determining message suitability such as system 200 in FIG. 2 ,according to an embodiment. At block 402, text strings collected fromone or more sources are processed. Text messages, voice messages, andimages provide sources of the text strings. Text strings can beextracted from one or more text messages 404, generated by convertingspeech to text 406, and/or generated by enhanced neural net imagecaption generator (eNNICG) 408 based on and corresponding to one or moreimages 410. The processing at block 402 extracts tokens (words) from thecollected text strings (messages), which are then stored at block 412 ina processed token database. At block 414, the tokens are used to createdocuments for training one or more machine learning classificationmodels. The machine learning can be augmented by weighting the tokenscomprising the training documents, the weights based on one or moregroup relationship graphs created at block 416. A group relationshipgraph can be constructed from explicit user input. Based on thedocuments one or more group models is generated at block 418. Based on agroup model and individualized documents, individual models aregenerated at block 420.

Text strings can be collected and processed on an on-going basis to keepthe models generated from text strings up to date and relevant. Thecollection can be performed intermittently at designated time intervalsdetermined using, for example, a job scheduler operating system utility.At the designated time intervals, the processed token database can bequeried for newly created messages and various classification modelsupdated based on the new messages. The tokens comprise discrete messagesand can be annotated when saved at block 412. For example, messages canbe annotated according to one or more of the following indicators: a“message saved time”; a “message ID”; a “message source”; a “chat groupID”; a “message sender ID”; and/or a “message recipient ID.” A document(AMD) can be created for each group based on the group ID and canincorporate messages exchanged over a specified period of time.Concurrently with the document creation, new group relationship graphscan be created and/or existing ones updated depending on any changingcircumstances related to the groups.

Creation of new message 422 by a user invokes a classifying of tokens(words) in the message at block 424. The tokens are extracted from themessage by the token processor and compared to tokens stored in systemmemory that have been determined to be related to topics that render amessage unsuited for sending. At block 426, a processor displays analarm at block 428 if one or more tokens extracted from the messageinclude ones identified based on topics determined by a group topicmodel or individual topic model as objectionable. If the message isdetermined to be unsuited for sending, the processor optionally canblock the sending of the message automatically without any response orinput from the user. Otherwise, if the message does not include one ormore tokens that are identified as objectionable, then the processorsends the message to the intended recipients at block 430.

Optionally, if a message is not classified as unsuitable for sending,but a user is nevertheless unsure of the message's appropriateness, theuser can access knowledge database 432. If based on the knowledgegained, the user determines the message should be classified unsuitablefor sending, the user can input information directly and/or incorporateinformation from knowledge database 432 into the system for update orrefine one or more topic models used by the system's token classifier.

FIG. 5 is a flowchart of method 500 for determining message suitability,according to an embodiment. Method 500 can be performed by a system thesame or similar to the systems described with reference to FIGS. 1-4 .The system at block 502 extracts tokens (words) from a message prior totransmitting the message over a communications network. At block 504,the system determines from the tokens one or more intended recipients ofthe message. The system selects a machine learning classification modelcorresponding to the one or more recipients of the message at block 506.The machine learning classification model can be constructed based ontokens extracted from prior messages that are combined to create aplurality of documents for training the machine learning classificationmodel. At block 508, the system classifies the tokens extracted from themessage using the machine learning classification model. If at block 510the system determines based on the classifying that the message isunsuited for sending, then the system, at block 512, can generate analert message in response to determining that the message is unsuitedfor sending.

The machine learning classification model can be a group topic model oran individual topic model (corresponding to a member of a group), themodel created based on messages exchanged by a specific group over aspecific span of time. An individual topic model corresponds to adesignated recipient of a message that is not addressed to the fullgroup.

In certain embodiments, the machine learning classification model is aprobabilistic topic model that statistically predicts at least one topicfor characterizing the language content of the plurality of documents.The probabilistic topic model can be an aLDA model, which is augmentedbased on a group relationship graph.

In some embodiments, different ones of the plurality of documents areindividually created at periodic intervals over a predetermined timeperiod. For example, a periodic determination can be made whether thesender and recipient(s) of the message have exchanged messagessubsequent to the creation of the documents. If so, one or more newdocuments can be created and, based on the newly created document(s),the machine learning classification model can be updated. Accordingly,new topics may be identified, some of which can comprise words (tokens)that if included in a message make the message unsuited for sending.

In other embodiments, the message and/or one or more prior messages cancomprise a text string generated in response to identifying an objectwithin an image using machine learning image recognition. The machinelearning image recognition can be performed by an enhanced neural netimage caption generator. The enhanced neural net image caption generatorcan recognize an image and generate a corresponding caption (e.g., usinga CNN caption generator), and associate the image with a topic based ona probabilistic topic model determination (e.g., made with an aLDA). Instill other embodiments, the message and/or one or more prior messagescan comprise a text string that is generated by converting a voice-basedmessage to text using a speech-to-text processor.

FIG. 6 is a flowchart of method 600 for generating a topic modelaccording to an embodiment. Method 600 can be performed by a system thesame or similar to the systems described with reference to FIGS. 1-6 .The system at block 602 creates a plurality of aggregated messagesdocuments (AMDs). The AMDs can be based on messages exchanged among aspecified group of users during a specific span of time. Optionally, ablock 604, the system can create, in response to user input, a grouprelationship graph based on a set of predefined relationships among thespecified group of users. Tokens (words) contained in the AMDS canoptionally be weighted at block 606. The weights can be determined basedon the optionally created group relationship graph. For example, if thespecified group comprises a collaborative work group, words contained inmessages authored by the collaborative work group's leader can beweighted more heavily than are those contained in messages authored byother members of the collaborative work group. Weights can be determinedaccording to other criteria as well. For example, weights can bedetermined based on the relative number of messages originating fromeach member of a chat group.

At block 608, the system builds a group topic model. The group topicmodel can be constructed using machine learning, wherein thegroup-specific, time-specific AMDs are used to train the group topicmodel. In some embodiments the group topic model is trained usingmachine learning based on a probabilistic topic model. The probabilistictopic model can be an aLDA model. Optionally, for one or more individualmembers of the specified group an individual-specific document based onthe messaging history of the individual(s) can be created at block 610.At block 612, one or more individual topic models optionally can becreated based on one or more individual's messaging history and thegroup topic model. An individual topic model is a topic model thatcorresponds to an individual member of the specified group and thusreflects the specific interests, opinions, concerns, feelings, emotions,and the like as expressed by messages gathered as part of theindividual's messaging history and captured by the group topic model.

FIG. 7 is a flowchart of method 700 for training an enhanced neural netimage caption generator according to an embodiment. Method 700 can beperformed by a system the same or similar to the systems described withreference to FIGS. 1-4 . The system, at block 702, trains an imagecaption generator to recognize objects within an image input to thesystem and to generate a caption corresponding to the image. The imagecaption generator can be trained using machine learning. In someembodiments, the image caption generator can comprise a convolutionalneural network that uses image pixels as features for learning imagerecognition based on a set of example training images. At block 704, thesystem retrieves a new image and one or more messages corresponding tothe image. The one or more messages can provide a chat context for theimage. Using the image caption generator, image recognition is performedby the system at block 706 to recognize objects within the new image andto generate a new image caption that corresponds to the new image. Atblock 708, the system incorporates the new image and correspondingcaption into an AMD and adds the AMD to other AMDs for constructing atopic model (e.g., group topic model and/or individual topic model)corresponding to a specific group of users (e.g., chat group,collaborative work group) based on messages exchanged over a specificspan of time. Through an iterative, machine learning process using atopic model, the system at block 710 determines discrete topics andassociates the new image and tokens (words) extracted from the AMDs. Thenew image, block 712, is labeled, the label based on the topicassociated with the new image as determined through the iterativemachine learning process using the topic model.

It is understood in advance that although this disclosure includes adetailed description on cloud computing, implementations of theteachings recited herein are not limited to a cloud computingenvironment. Rather, embodiments of the present invention are capable ofbeing implemented in conjunction with any other type of computingenvironment now known or later developed.

Cloud computing is a model of service delivery for enabling convenient,on-demand network access to a shared pool of configurable computingresources (e.g., networks, network bandwidth, servers, processing,memory, storage, applications, virtual machines, and services) that canbe rapidly provisioned and released with minimal management effort orinteraction with a provider of the service. This cloud model may includeat least five characteristics, at least three service models, and atleast four deployment models.

Characteristics are as follows:

On-demand self-service: a cloud consumer can unilaterally provisioncomputing capabilities, such as server time and network storage, asneeded automatically without requiring human interaction with theservice's provider.

Broad network access: capabilities are available over a network andaccessed through standard mechanisms that promote use by heterogeneousthin or thick client platforms (e.g., mobile phones, laptops, and PDAs).

Resource pooling: the provider's computing resources are pooled to servemultiple consumers using a multi-tenant model, with different physicaland virtual resources dynamically assigned and reassigned according todemand. There is a sense of location independence in that the consumergenerally has no control or knowledge over the exact location of theprovided resources but may be able to specify location at a higher levelof abstraction (e.g., country, state, or datacenter).

Rapid elasticity: capabilities can be rapidly and elasticallyprovisioned, in some cases automatically, to quickly scale out andrapidly released to quickly scale in. To the consumer, the capabilitiesavailable for provisioning often appear to be unlimited and can bepurchased in any quantity at any time.

Measured service: cloud systems automatically control and optimizeresource use by leveraging a metering capability at some level ofabstraction appropriate to the type of service (e.g., storage,processing, bandwidth, and active user accounts). Resource usage can bemonitored, controlled, and reported providing transparency for both theprovider and consumer of the utilized service.

Service Models are as follows:

Software as a Service (SaaS): the capability provided to the consumer isto use the provider's applications running on a cloud infrastructure.The applications are accessible from various client devices through athin client interface such as a web browser (e.g., web-based email). Theconsumer does not manage or control the underlying cloud infrastructureincluding network, servers, operating systems, storage, or evenindividual application capabilities, with the possible exception oflimited user-specific application configuration settings.

Platform as a Service (PaaS): the capability provided to the consumer isto deploy onto the cloud infrastructure consumer-created or acquiredapplications created using programming languages and tools supported bythe provider. The consumer does not manage or control the underlyingcloud infrastructure including networks, servers, operating systems, orstorage, but has control over the deployed applications and possiblyapplication hosting environment configurations.

Infrastructure as a Service (IaaS): the capability provided to theconsumer is to provision processing, storage, networks, and otherfundamental computing resources where the consumer is able to deploy andrun arbitrary software, which can include operating systems andapplications. The consumer does not manage or control the underlyingcloud infrastructure but has control over operating systems, storage,deployed applications, and possibly limited control of select networkingcomponents (e.g., host firewalls).

Deployment Models are as follows:

Private cloud: the cloud infrastructure is operated solely for anorganization. It may be managed by the organization or a third party andmay exist on-premises or off-premises.

Community cloud: the cloud infrastructure is shared by severalorganizations and supports a specific community that has shared concerns(e.g., mission, security requirements, policy, and complianceconsiderations). It may be managed by the organizations or a third partyand may exist on-premises or off-premises.

Public cloud: the cloud infrastructure is made available to the generalpublic or a large industry group and is owned by an organization sellingcloud services.

Hybrid cloud: the cloud infrastructure is a composition of two or moreclouds (private, community, or public) that remain unique entities butare bound together by standardized or proprietary technology thatenables data and application portability (e.g., cloud bursting forload-balancing between clouds).

A cloud computing environment is service oriented with a focus onstatelessness, low coupling, modularity, and semantic interoperability.At the heart of cloud computing is an infrastructure comprising anetwork of interconnected nodes.

Referring now to FIG. 8 , illustrative computing environment 850 isdepicted. As shown, cloud computing environment 850 includes one or morecomputing nodes 810 with which local computing devices used by cloudconsumers, such as, for example, personal digital assistant (PDA) orcellular telephone 854 a, desktop computer 854 b, laptop computer 854 c,and/or automobile computer system 854 n may communicate. Computing nodes810 may communicate with one another. They may be grouped (not shown)physically or virtually, in one or more networks, such as Private,Community, Public, or Hybrid clouds as described hereinabove, or acombination thereof. This allows cloud computing environment 850 tooffer infrastructure, platforms and/or software as services for which acloud consumer does not need to maintain resources on a local computingdevice. It is understood that the types of computing devices 854 a-854 nshown in FIG. 8 are intended to be illustrative only and that computingnodes 810 and cloud computing environment 850 can communicate with anytype of computerized device over any type of network and/or networkaddressable connection (e.g., using a web browser).

Referring now to FIG. 9 , a set of functional abstraction layersprovided by cloud computing environment 950 (FIG. 8 ) is shown. Itshould be understood in advance that the components, layers, andfunctions shown in FIG. 9 are intended to be illustrative only andembodiments of the invention are not limited thereto. As depicted, thefollowing layers and corresponding functions are provided:

Hardware and software layer 960 includes hardware and softwarecomponents. Examples of hardware components include: mainframes 961;RISC (Reduced Instruction Set Computer) architecture based servers 962;servers 963; blade servers 964; storage devices 965; and networks andnetworking components 966. In some embodiments, software componentsinclude network application server software 967 and database software968.

Virtualization layer 970 provides an abstraction layer from which thefollowing examples of virtual entities may be provided: virtual servers971; virtual storage 972; virtual networks 973, including virtualprivate networks; virtual applications and operating systems 974; andvirtual clients 975.

In one example, management layer 980 may provide the functions describedbelow. Resource provisioning 981 provides dynamic procurement ofcomputing resources and other resources that are utilized to performtasks within the cloud computing environment. Metering and Pricing 982provide cost tracking as resources are utilized within the cloudcomputing environment, and billing or invoicing for consumption of theseresources. In one example, these resources may include applicationsoftware licenses. Security provides identity verification for cloudconsumers and tasks, as well as protection for data and other resources.User portal 983 provides access to the cloud computing environment forconsumers and system administrators. Service level management 984provides cloud computing resource allocation and management such thatrequired service levels are met. Service Level Agreement (SLA) planningand fulfillment 985 provide pre-arrangement for, and procurement of,cloud computing resources for which a future requirement is anticipatedin accordance with an SLA. Workloads layer 990 provides examples offunctionality for which the cloud computing environment may be utilized.Examples of workloads and functions which may be provided from thislayer include: mapping and navigation 991; software development andlifecycle management 992; virtual classroom education delivery 993; dataanalytics processing 994; transaction processing 995; and system 996 fordetermining message suitability/unsuitability.

FIG. 10 illustrates a schematic of an example of a computing node 1000.In one or more embodiments, computing node 1000 is an example of asuitable cloud computing node. Computing node 1000 is not intended tosuggest any limitation as to the scope of use or functionality ofembodiments of the invention described herein. Computing node 1000 iscapable of performing any of the functionality described within thisdisclosure.

Computing node 1000 includes a computer system 1012, which isoperational with numerous other general-purpose or special-purposecomputing system environments or configurations. Examples of well-knowncomputing systems, environments, and/or configurations that may besuitable for use with computer system 1012 include, but are not limitedto, personal computer systems, server computer systems, thin clients,thick clients, hand-held or laptop devices, multiprocessor systems,microprocessor-based systems, set top boxes, programmable consumerelectronics, network PCs, minicomputer systems, mainframe computersystems, and distributed cloud computing environments that include anyof the above systems or devices, and the like.

Computer system 1012 may be described in the general context of computersystem-executable instructions, such as program modules, being executedby a computer system. Generally, program modules may include routines,programs, objects, components, logic, data structures, and so on thatperform particular tasks or implement particular abstract data types.Computer system 1012 may be practiced in distributed cloud computingenvironments where tasks are performed by remote processing devices thatare linked through a communications network. In a distributed cloudcomputing environment, program modules may be located in both local andremote computer system storage media including memory storage devices.

As shown in FIG. 10 , computer system 1012 is shown in the form of ageneral-purpose computing device. The components of computer system 1012may include, but are not limited to, one or more processors 1016, amemory 1028, and a bus 1018 that couples various system componentsincluding memory 1028 to processor 1016. As defined herein, “processor”means at least one hardware circuit configured to carry outinstructions. The hardware circuit may be an integrated circuit.Examples of a processor include, but are not limited to, a centralprocessing unit (CPU), an array processor, a vector processor, a digitalsignal processor (DSP), a field-programmable gate array (FPGA), aprogrammable logic array (PLA), an application specific integratedcircuit (ASIC), programmable logic circuitry, and a controller.

Bus 1018 represents one or more of any of several types of busstructures, including a memory bus or memory controller, a peripheralbus, an accelerated graphics port, and a processor or local bus usingany of a variety of bus architectures. By way of example only, and notlimitation, such architectures include Industry Standard Architecture(ISA) bus, Micro Channel Architecture (MCA) bus, Enhanced ISA (EISA)bus, Video Electronics Standards Association (VESA) local bus,Peripheral Component Interconnect (PCI) bus, and PCI Express (PCIe) bus.

Computer system 1012 typically includes a variety of computersystem-readable media. Such media may be any available media that isaccessible by computer system 1012, and may include both volatile andnon-volatile media, removable and non-removable media.

Memory 1028 may include computer system readable media in the form ofvolatile memory, such as random-access memory (RAM) 1030 and/or cachememory 1032. Computer system 1012 may further include otherremovable/non-removable, volatile/non-volatile computer system storagemedia. By way of example, storage system 1034 can be provided forreading from and writing to a non-removable, non-volatile magnetic mediaand/or solid-state drive(s) (not shown and typically called a “harddrive”). Although not shown, a magnetic disk drive for reading from andwriting to a removable, non-volatile magnetic disk (e.g., a “floppydisk”), and an optical disk drive for reading from or writing to aremovable, non-volatile optical disk such as a CD-ROM, DVD-ROM or otheroptical media can be provided. In such instances, each can be connectedto bus 1018 by one or more data media interfaces. As will be furtherdepicted and described below, memory 1028 may include at least oneprogram product having a set (e.g., at least one) of program modulesthat are configured to carry out the functions of embodiments of theinvention.

Program/utility 1040, having a set (at least one) of program modules1042, may be stored in memory 1028 by way of example, and notlimitation, as well as an operating system, one or more applicationprograms, other program modules, and program data. Each of the operatingsystem, one or more application programs, other program modules, andprogram data or some combination thereof, may include an implementationof a networking environment. Program modules 1042 generally carry outthe functions and/or methodologies of embodiments of the invention asdescribed herein. For example, one or more of the program modules mayinclude modules for implementing a system for determining messagesuitability, or portions thereof.

Program/utility 1040 is executable by processor 1016. Program/utility1040 and any data items used, generated, and/or operated upon bycomputer system 1012 are functional data structures that impartfunctionality when employed by computer system 1012. As defined withinthis disclosure, a “data structure” is a physical implementation of adata model's organization of data within a physical memory. As such, adata structure is formed of specific electrical or magnetic structuralelements in a memory. A data structure imposes physical organization onthe data stored in the memory as used by an application program executedusing a processor.

Computer system 1012 may also communicate with one or more externaldevices 1014 such as a keyboard, a pointing device, a display 1024,etc.; one or more devices that enable a user to interact with computersystem 1012; and/or any devices (e.g., network card, modem, etc.) thatenable computer system 1012 to communicate with one or more othercomputing devices. Such communication can occur via input/output (I/O)interfaces 1022. Still, computer system 1012 can communicate with one ormore networks such as a local area network (LAN), a general wide areanetwork (WAN), and/or a public network (e.g., the Internet) via networkadapter 1020. As depicted, network adapter 1020 communicates with theother components of computer system 1012 via bus 1018. It should beunderstood that although not shown, other hardware and/or softwarecomponents could be used in conjunction with computer system 1012.Examples, include, but are not limited to: microcode, device drivers,redundant processing units, external disk drive arrays, RAID systems,tape drives, and data archival storage systems, etc.

While computing node 1000 is used to illustrate an example of a cloudcomputing node, it should be appreciated that a computer system using anarchitecture the same as or similar to that described in connection withFIG. 10 may be used in a non-cloud computing implementation to performthe various operations described herein. In this regard, the exampleembodiments described herein are not intended to be limited to a cloudcomputing environment. Computing node 1000 is an example of a dataprocessing system. As defined herein, “data processing system” means oneor more hardware systems configured to process data, each hardwaresystem including at least one processor programmed to initiateoperations and memory.

Computing node 1000 is an example of computer hardware. Computing node1000 may include fewer components than shown or additional componentsnot illustrated in FIG. 10 depending upon the particular type of deviceand/or system that is implemented. The particular operating systemand/or application(s) included may vary according to device and/orsystem type as may the types of I/O devices included. Further, one ormore of the illustrative components may be incorporated into, orotherwise form a portion of, another component. For example, a processormay include at least some memory.

Computing node 1000 is also an example of a server. As defined herein,“server” means a data processing system configured to share serviceswith one or more other data processing systems. As defined herein,“client device” means a data processing system that requests sharedservices from a server, and with which a user directly interacts.Examples of a client device include, but are not limited to, aworkstation, a desktop computer, a computer terminal, a mobile computer,a laptop computer, a netbook computer, a tablet computer, a smart phone,a personal digital assistant, a smart watch, smart glasses, a gamingdevice, a set-top box, a smart television and the like. In one or moreembodiments, the various user devices described herein may be clientdevices. Network infrastructure, such as routers, firewalls, switches,access points and the like, are not client devices as the term “clientdevice” is defined herein.

The terminology used herein is only for the purpose of describingparticular embodiments and is not intended to be limiting.Notwithstanding, several definitions that apply throughout this documentare now presented.

As defined herein, the singular forms of terms “a,” “an,” and “the” areintended to include the plural forms as well, unless the context clearlyindicates otherwise.

As defined herein, “another” means at least a second or more.

As defined herein, “at least one,” “one or more,” and “and/or,” areopen-ended expressions that are both conjunctive and disjunctive inoperation unless explicitly stated otherwise. For example, each of theexpressions “at least one of A, B and C,” “at least one of A, B, or C,”“one or more of A, B, and C,” “one or more of A, B, or C,” and “A, B,and/or C” means A alone, B alone, C alone, A and B together, A and Ctogether, B and C together, or A, B and C together.

As defined herein, “automatically” means without user intervention.

As defined herein, “computer readable storage medium” means a storagemedium that contains or stores program code for use by or in connectionwith an instruction execution system, apparatus, or device. “Computerreadable storage medium,” as defined herein, is not a transitory,propagating signal per se. A computer readable storage medium may be,but is not limited to, an electronic storage device, a magnetic storagedevice, an optical storage device, an electromagnetic storage device, asemiconductor storage device, or any suitable combination of theforegoing. Memory elements, as described herein, are examples of acomputer readable storage medium. A non-exhaustive list of more specificexamples of a computer readable storage medium may include: a portablecomputer diskette, a hard disk, a random-access memory (RAM), aread-only memory (ROM), an erasable programmable read-only memory (EPROMor Flash memory), a static random-access memory (SRAM), a digitalversatile disk (DVD), a memory stick, a floppy disk, or the like.

As defined herein, “includes,” “including,” “comprises,” and/or“comprising,” specify the presence of stated features, integers, steps,operations, elements, and/or components, but do not preclude thepresence or addition of one or more other features, integers, steps,operations, elements, components, and/or groups thereof.

As defined herein, “if” means “when” or “upon” or “in response to” or“responsive to,” depending upon the context. Thus, the phrase “if it isdetermined” or “if [a stated condition or event] is determined” may beconstrued to mean “upon determining” or “in response to determining.”Similarly the phrase “if it is detected” or “if [a stated condition orevent] is detected” may be construed to mean “in response to detecting[the stated condition or event]” or “responsive to detecting [the statedcondition or event]” depending on the context.

As defined herein, “one embodiment,” “an embodiment,” “in one or moreembodiments,” “in particular embodiments,” or similar language mean thata particular feature, structure, or characteristic described inconnection with the embodiment is included in at least one embodimentdescribed within this disclosure. Thus, appearances of theaforementioned phrases and/or similar language throughout thisdisclosure may, but do not necessarily, all refer to the sameembodiment.

As defined herein, “output” means storing in physical memory elements,e.g., devices, writing to display or other peripheral output device,sending or transmitting to another system, exporting, or the like.

As defined herein, “processor” means at least one hardware circuitconfigured to carry out instructions contained in program code. Thehardware circuit may be an integrated circuit. Examples of a processorinclude, but are not limited to, a central processing unit (CPU), anarray processor, a vector processor, a digital signal processor (DSP), afield-programmable gate array (FPGA), a programmable logic array (PLA),an application-specific integrated circuitry (ASIC), programmable logiccircuitry, and a controller.

As defined herein, “real time” means a level of processingresponsiveness that a user or system senses as sufficiently immediatefor a particular process or determination to be made, or that enablesthe processor to keep up with some external process.

As defined herein, “in response to” and “responsive to” mean respondingor reacting readily to an action or event. Thus, if a second action isperformed “in response to” or “responsive to” a first action, there is acausal relationship between an occurrence of the first action and anoccurrence of the second action. The terms “in response to” and“responsive to” indicate the causal relationship.

As defined herein, “substantially” means that the recitedcharacteristic, parameter, or value need not be achieved exactly, butthat deviations or variations, including for example, tolerances,measurement error, measurement accuracy limitations, and other factorsknown to those of skill in the art, may occur in amounts that do notpreclude the effect the characteristic was intended to provide.

As defined herein, the terms “user,” “individual,” “member,” and“author” refer to a human being. Accordingly, “users,” “individuals,”“members,” and “authors” refer to multiple human beings.

The terms first, second, etc. may be used herein to describe variouselements. These elements should not be limited by these terms, as theseterms are only used to distinguish one element from another unlessstated otherwise or the context clearly indicates otherwise.

Various embodiments of the inventive aspects disclosed herein may beimplemented in a system, as a method, and/or in a computer programproduct at any possible technical detail level of integration. Thecomputer program product may include a computer readable storage medium(or media) having computer readable program instructions thereon forcausing a processor to carry out aspects of the embodiments disclosedherein. “Program code” is used interchangeably with “computer readableprogram instructions” within this disclosure. Computer readable programinstructions described herein may be downloaded to respectivecomputing/processing devices from a computer readable storage medium orto an external computer or external storage device via a network, suchas the Internet, a LAN, a WAN, and/or a wireless network. The networkmay include copper transmission cables, optical transmission fibers,wireless transmissions, routers, firewalls, switches, gateway computers,and/or edge devices including edge servers. A network adapter cord ornetwork interface in each computing/processing device receives computerreadable program instructions from the network and forwards the computerreadable program instructions for storage in a computer readable storagemedium with the respective computing/processing device.

Computer readable program instructions for carrying out operations ofthe inventive arrangements disclosed herein may be assemblerinstructions, instruction-set-architecture (ISA) instructions, machineinstructions, machine dependent instructions, microcode, firmwareinstructions, state-setting data, configuration data for integratedcircuitry, or either source code or object code written in anycombination of one or more programming languages, including an objectoriented programming language and/or procedural programming languages.The computer readable program instructions may execute entirely on auser's computer, partly on the user's computer, as a stand-alonesoftware package, partly on the user's computer and partly on a remotecomputer or entirely on the remote computer or server. In the latterscenario, the remote computer may be connected to the user's computerthrough any type of network, including a LAN or a WAN, or the connectionmay be made to an external computer (for example, through the Internetusing an Internet Service Provider). In some embodiments, electroniccircuitry including, for example, programmable logic circuitry, an FPGA,or a PLA may execute the computer readable program instructions byutilizing state information of the computer readable programinstructions to personalize the electronic circuitry, in order toperform aspects of the inventive arrangements described herein.

Certain aspects of the inventive arrangements are described herein withreference to flowchart illustrations and/or block diagrams of methods,apparatus (systems), and computer program products according toembodiments of the inventive arrangements. It will be understood thateach block of the flowchart illustrations and/or block diagrams, andcombinations of blocks in the flowchart illustrations and/or blockdiagrams, can be implemented by computer readable program instructions(e.g., program code).

These computer readable program instructions may be provided to aprocessor of a computer, special-purpose computer or other programmabledata processing apparatus to produce a machine, such that theinstructions, which execute via the processor of the computer or otherprogrammable data processing apparatus, create means for implementingthe functions/acts specified in the flowchart and/or block diagram blockor blocks. Operatively coupling the processor to program codeinstructions transforms the machine of the processor into aspecial-purpose machine for carrying out the instructions of the programcode. These computer readable program instructions may also be stored ina computer readable storage medium that can direct a computer, aprogrammable data processing apparatus, and/or other devices to functionin a particular manner, such that the computer readable storage mediumhaving instructions stored therein comprises an article of manufactureincluding instructions which implement aspects of the function/actspecified in the flowchart and/or block diagram block or blocks.

The computer readable program instructions may also be loaded onto acomputer, other programmable data processing apparatus, or other deviceto cause a series of operational steps to be performed on the computer,other programmable apparatus or other device to produce a computerimplemented process, such that the instructions which execute on thecomputer, other programmable apparatus, or other device implement thefunctions/acts specified in the flowchart and/or block diagram block orblocks.

The flowchart and block diagrams in the Figures illustrate thearchitecture, functionality, and operation of possible implementationsof systems, methods, and computer program products according to variousembodiments of the inventive arrangements described herein. In thisregard, each block in the flowchart or block diagrams may represent amodule, segment, or portion of instructions, which comprises one or moreexecutable instructions for implementing the specified logicalfunction(s). In some alternative implementations, the functions noted inthe blocks may occur out of the order noted in the Figures. For example,two blocks shown in succession may, in fact, be accomplished as onestep, executed concurrently, substantially concurrently, in a partiallyor wholly temporally overlapping manner, or the blocks may sometimes beexecuted in the reverse order, depending upon the functionalityinvolved. It will also be noted that each block of the block diagramsand/or flowchart illustration, and combinations of blocks in the blockdiagrams and/or flowchart illustration, can be implemented by specialpurpose hardware-based systems that perform the specified functions oracts or carry out combinations of special purpose hardware and computerinstructions.

The descriptions of the various embodiments provided herein have beenpresented for purposes of illustration and are not intended to beexhaustive or limited to the form and examples disclosed. Theterminology used herein was chosen to explain the principles of theinventive arrangements, the practical application or technicalimprovement over technologies found in the marketplace, and/or to enableothers of ordinary skill in the art understand the embodiments disclosedherein. Modifications and variations may be apparent to those ofordinary skill in the art without departing from the scope and spirit ofthe described inventive arrangements. Accordingly, reference should bemade to the following claims, rather than the foregoing disclosure, asindicating the scope of such features and implementations.

What is claimed is:
 1. A method, comprising: extracting, with computerhardware, tokens from a message prior to transmitting the message over acommunications network; determining from the tokens one or more intendedrecipients of the message; selecting a machine learning classificationmodel corresponding to the one or more recipients of the message, themachine learning classification model constructed based on tokensextracted from prior messages, the prior messages being combined tocreate a plurality of documents for training the machine learningclassification model; classifying one or more tokens extracted from themessage using the machine learning classification model; and generatingan alert message in response to determining based on the classifyingthat the message is unsuited for sending.
 2. The method of claim 1,wherein the machine learning classification model is a probabilistictopic model that statistically predicts at least one topic forcharacterizing language content of the plurality of documents.
 3. Themethod of claim 2, wherein the probabilistic topic model is an augmentedlatent Dirichlet allocation model augmented based on a grouprelationship graph.
 4. The method of claim 1, wherein different ones ofthe plurality of documents are individually created at periodicintervals over a predetermined time period.
 5. The method of claim 1,wherein at least one of the message or prior messages comprises a textstring generated in response to identifying an object within an imageusing machine learning image recognition.
 6. The method of claim 5,wherein the image recognition is performed by an enhanced neural netimage caption generator.
 7. The method of claim 1, wherein at least oneof the message or prior messages comprises a text string that isgenerated by converting a voice-based message to text using aspeech-to-text processor.
 8. A system, comprising: a hardware processorconfigured to initiate operations including: extracting tokens from amessage prior to transmitting the message over a communications network;determining from the tokens one or more intended recipients of themessage; selecting a machine learning classification model correspondingto the one or more recipients of the message, the machine learningclassification model constructed based on tokens extracted from priormessages, the prior messages being combined to create a plurality ofdocuments for training the machine learning classification model;classifying one or more tokens extracted from the message using themachine learning classification model; and generating an alert messagein response to determining based on the classifying that the message isunsuited for sending.
 9. The system of claim 8, wherein the machinelearning classification model is a probabilistic topic model thatstatistically predicts at least one topic for characterizing languagecontent of the plurality of documents.
 10. The system of claim 9,wherein the probabilistic topic model is an augmented latent Dirichletallocation model augmented based on a group relationship graph.
 11. Thesystem of claim 8, wherein different ones of the plurality of documentsare individually created at periodic intervals over a predetermined timeperiod.
 12. The system of claim 8, wherein at least one of the messageor prior messages comprises a text string generated in response toidentifying an object within an image using machine learning imagerecognition.
 13. The system of claim 12, wherein the image recognitionis performed by an enhanced neural net image caption generator.
 14. Acomputer program product, the computer program product comprising: oneor more computer-readable storage media and program instructionscollectively stored on the one or more computer-readable storage media,the program instructions executable by a processor to cause theprocessor to initiate operations including: extracting tokens from amessage prior to transmitting the message over a communications network;determining from the tokens one or more intended recipients of themessage; selecting a machine learning classification model correspondingto the one or more recipients of the message, the machine learningclassification model constructed based on tokens extracted from priormessages, the prior messages being combined to create a plurality ofdocuments for training the machine learning classification model;classifying one or more tokens extracted from the message using themachine learning classification model; and generating an alert messagein response to determining based on the classifying that the message isunsuited for sending.
 15. The computer program product of claim 14,wherein the machine learning classification model is a probabilistictopic model that statistically predicts at least one topic forcharacterizing language content of the plurality of documents.
 16. Thecomputer program product of claim 15, wherein the probabilistic topicmodel is an augmented latent Dirichlet allocation model augmented basedon a group relationship graph.
 17. The computer program product of claim14, wherein different ones of the plurality of documents areindividually created at periodic intervals over a predetermined timeperiod.
 18. The computer program product of claim 14, wherein at leastone of the message or prior messages comprises a text string generatedin response to identifying an object within an image using machinelearning image recognition.
 19. The computer program product of claim18, wherein the image recognition is performed by an enhanced neural netimage caption generator.
 20. The computer program product of claim 14,wherein at least one of the message or prior messages comprises a textstring that is generated by converting a voice-based message to textusing a speech-to-text processor.